Experimentally realizable control fields in quantum Lyapunov control 
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As a hybrid of techniques from open-loop and feedback control, Lyapunov control has the ad- 
vantage that it is free from the measurement-induced decoherence but it includes the system's 
instantaneous message in the control loop. Often, the Lyapunov control is confronted with time 
delay in the control fields and difficulty in practical implementations of the control. In this paper, 
we study the effect of time-delay on the Lyapunov control, and explore the possibility of replacing 
the control field with a pulse train or a bang-bang signal. The efficiency of the Lyapunov control 
is also presented through examining the convergence time of the controlled system. These results 
suggest that the Lyapunov control is robust gainst time delay, easy to realize and effective for 
high-dimensional quantum systems. 

PACS numbers: 03.65.-w, 03.67.Pp, 02.30.Yy 



I. INTRODUCTION 

Quantum technologies, such as quantum information 
processing, offer many advantages over their classical 
counterparts, but it is challenging to make these new 
technologies function robustly due to the presence of 
noise. Quantum control — the application of control the- 
ory to quantum systems — provides a gateway to develop 
robust quantum technologies P, 0. Open- loop control 
and closed-loop control (feedback control) are by def- 
inition distinct but complementary control methodolo- 
gies [ij. Open- loop control is usually independent of 
measurement while feedback control, in contrast, involves 
measurement. Both types of control have been shown to 
be powerfully experimental and theoretical tools in clas- 
sical and quantum contexts. For example, optimal gate 
synthesis by open- loop control Q, decoherence suppres- 
sion by bang-bang control and dynamical decoupling [3] , 
stabilization of pure and entangled states by feedback 
control Q , as well as the applications of feedback control 
in precision metrology and hypothesis testing Q . 

In spite of some progress made, there are signif- 
icant challenges facing the field, in particular, the 
measurement-induced decoherence in quantum feedback 
control and that stemming from experimental realiza- 
tions of control fields in open-loop control. Lyapunov 
control is a hybrid of techniques from open-loop and feed- 
back controls, it uses a feedback design to construct con- 
trol fields but applies the fields into the system in an 
open-loop way. In other words, Lyapunov control is used 
to design a feedback law firstly which is then used to 
find the open-loop control by simulating the closed-loop 
system; next the control is applied to the quantum sys- 
tem in an open-loop way. From the above description 
of Lyapunov control, we find that the Lyapunov control 
includes two steps. For any initial states and a system 
Hamiltonian (assumed to be known exactly), the first 
step is to design a control law, i.e., to calculate the con- 



trol field by simulating the dynamics of the closed-loop 
system. The second step is to apply the control law to 
the control system as an open-loop control. 

Although the Lyapunov control is not limited by the 
measurement-induced decoherence, it is often confronted 
with time-delays and realizability of the control fields in 
practical experiments. In this paper, we will shed light on 
these issues by examining Lyapunov control on a finite 
dimensional system. The following issues will be clar- 
ified: (1) The robustness of Lyapunov control against 
time-delay in the control fields; (2) the number of pulses 
necessary to simulate the control fields; (3) the possibil- 
ity to replace the control fields with bang-bang signals, 
and (4) the efficiency of the Lyapunov control. 

The paper is organized as follows. In Sec. II, we in- 
troduce the model and explore the convergency of the 
Lyapunov control. In Sec. Ill, we examine the effect of 
time-delay on the control fidelity. In Sec. IV, we intro- 
duce a pulse train to simulate the control field, and study 
the dependence of the fidelity on the number of pulses. 
The possibility to replace the pulse train with bang-bang 
signals and the efficiency of the Lyapunov control are 
also explored in this section. Finally we end in Sec.V 
with discussions. 



II. MODEL DESCRIPTION AND 
CONVERGENCY OF THE CONTROL 

Consider a quantum system governed by {h = 1) 



(1) 



where Hq and Hi are n x n Hermitian matrices. Here 
Hq is a time independent Hamiltonian, corresponding to 
the free evolution of the system in absence of any exter- 
nal fields. The external interaction is taken into account 
as couplings f{t)Hi between a control field f{t) and the 
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system (through a time-independent Hermitian operator 
Hi). The state \ilj{t)) is normahzed, \{'tp{t)\'ip{t))\ = 1. 
Our goal is to steer an arbitrary initial state |V'o) to the 
ground state of Hq, say \(j)g). Although the ground state 
of Hq is specified as the target state in this paper, the 
present method is not limited to this choice. In fact 
the method works for any target states that are eigen- 
states of Hq. Define the following real- value function 
Vi\m)Mg)), 



the eigenvectors of A, 



vim))A4'g)) = i-\mM,)\', 



(2) 



we find V ^2f{t)^i{^gm))m)\Hi\(f>g)), where 
denotes the imaginary part of (...). By choosing 



fit) ^ ~k^{{cj,g\m){m\Hi\^s)), 



(3) 



with k > 0, V decreases along a trajectory that leads the 
system from the initial state to the target state. Namely, 
any control field of the form given in Eq. ([3]) ensures V < 
0. With such a control field f{t), the distance between the 
actual state the goal state |(/>g) decreases. 

We prove the convergence of \ip{t)) to the target state 
\(j)g) (i.e., asymptotic stability) by showing that the 
LaSalle invariant set V of states satisfying = does 
not contain trajectories of the system, except the trajec- 
tories that lead the system to the target state. Clearly, 



y = is equivalent to 9((0g|V'(t))(-0(i)|i?i|0g)) 



0. 



Notice that 5(a6) = if and only if there exists a real 
numbers A such that Xa — b* . This is exactly the case for 
9(((/)g|V'(0)(^WI^ri|(/)3)) = 0, if (V'(OI'/'s) 7^ 0. Therefore 
if IV'(O) belongs to V, it must satisfy {ipglXl — Hi\ilj{t)) ~ 
or {'ip{t)\(f>g) — 0, where I denotes the identity op- 
erator. This means that the set of states orthogonal 
to \(j)g) or being eigenstates of Hi must include the in- 
variant set V. Namely, V C {|-0(i)) : ('0(i)l0g) = 
or Hi\i;{t)) = Xlipit)) for any A}. For V to be 
asymptotic invariant, the state in V must be an eigen- 
state of Hq, because the free Hamiltonian can usually 
not be turned off. In other words, if a state is not an 
eigenstate of Hq, it must evolve even if the control field 
f{t) is zero, and in consequence f{t) would get a non-zero 
value and thus the state would be outside the invariant 
set. All these together yield that the LaSalle invariant 
set V = {IV') : Hol^p) = Eo\^) for any Eq}. We caU the 
states in the invariant set critical points of V, which repre- 
sent the maximum or minimum of the Lyapunov function 
V. For a n-dimensional non-degenerate quantum system, 
there are n critical points, we now show that the maximal 
critical value occurs only when \ip{t)) = |(/>g). 

Define operator A = I — |(/)g)((/)g|, the Lyapunov func- 
tion can be rewritten as V{\ilj{t)), |(/>g)) = {'4'{t)\A\^{t)) . 
Obviously, A and Ho have the same eigenstates. We de- 
note the eigenstates of A as \Aj) [j — l,2,...,n) with 
corresponding eigenvalues Aj. To determine the struc- 
ture of V{\il}{t)), |(/)g)) around one of its critical points, 
say \ipc) = \Ac) (c may be one of l,2,...,n), we con- 
sider an infinitesimal variation \'ipc + 5^) of jV'c) such that 
(■0c + ^V'lV'c + ^0) = 1- Express |-0c + ^V') in the basis of 



\i^, + 5i^)^\A,)+Y,5,\A,) 



(4) 



The normalization condition (t/'c + '5'0|'0c + Sij:) = 1 fol- 
lows, 

n 

{S* + S,) + TS*S,=0. 



Then 



Vil^P, + S^)) - Vili;,)) = ^(A, - A,)S*S,. (5) 

Considering 5j as variation parameters and noting djSj > 
0, we find that the structure of V{\ip{t)), \(j)g)) around the 
critical point jV'c) depends on the ordering of the eigen- 
values of A. \ipc) is a local maximum as a function of the 
variations dj if and only if Ac is the largest eigenvalue of 
A, and a local minimum iff Ac is the smallest eigenvalue 
and a saddle point otherwise. This observation leads us 
to suspect that the minimum of V is asymptotically at- 
tractive, in other words, the control field based on this 
Lyapunov function would drive the open system to the 
eigenstate of A with the smallest eigenvalue, which is ex- 
actly the target state |0g). 



III. TIME-DELAY EFFECT 

For practical implementation of the Lyapunov-based 
control, a non-negligible (positive or negative) time delay 
is required to be taken into account. These delays may 
stem from actuators and electronic devices in the control 
loop @. Before moving to the analytical discussions, we 
first examine the effect of time-delay on the fidelity of 
the Lyapunov control through an example. 

Take a 5-dimensional system as an example, and 
choose 
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Hn = 



(6) 



as the free Hamiltonian. Let us use the previous Lya- 
punov control in order to trap our system in the ground 
state \(j)g) = (1,0,0,0,0)^ oi Hq. Setting 



Hi 
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(7) 



as the control Hamiltonian and writing the actual state 
of the system as 

m)) = {Mt),Mt),Mt),Mt),Mt)f, (8) 
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we obtain the control field by substituting \ip{t)),\(j)g), 
and Hi into Eq.®, 

fit) = -^[Mt)mt) + r^{t) + rs) + i^um- (9) 

Consider Eq. ^ without time-delay in /(i), it has been 
proved that |13|] , (1) if the spectrum of is not degener- 
ate, the invariant set of the closed loop system is spanned 
by the eigenstates |$) of Hq such that = 0; 

and (2) when the invariant set reduces to — |'/>g)}, 

the state \4>g) is exponentially stable, while —\4'g) is un- 
stable. This means that the system would converge to 
\(j)g) under the control. Hence in the case of no time- 
delay, the control field f{t) perfectly steers the system 
into the target state \4'g)- The situation changes when 
the time delay is not zero. Note that the controlled dy- 
namics Eq.(IT|) depends on the delay through the control 
field f{t — t) significantly, the control problem would be 
much more different than that without time-delay. We 
shall quantify the effect of time delay on the controlled 
dynamics through control fidelity defined by, 



FiglT] shows the control fidelity as a function of time and 
the dependence of final control fidelity on the time delay 
(see the inset) . We find that in the presence of time delay, 
the final control fidelity depends not only on the delay 
time, but also on initial states. Moreover, we observe 
that the negative time delay and positive time delay are 
same for very small time delay but different for large time 
delay, e.g., the control fidelity is sensitive to positive time 
delays more than to the negative time delay. This can 
be understood as follows. Consider a small time delay r, 
the control field f{t— r) can be expanded up to second 
order in as 



fit ~t)^ fit) 



dm 

dt 



1 d'fjt) 2 

2 dt^ ' 



(11) 



By simple algebra, we obtain, 
dfit) 



at 



zk^i{cj,g\[H,\m){m\]HM)^ 



Fit) = \{ci,g\m)? 



(10) 



d'fit) 
dt^ 



= k^i{<j)g\H^m)){m\Hi 



m)){m\H'Hi 
I 



2Hm))m)\HHi\^g)). 



Without time delay, the system would approach \(f>g) as 
time tends to the convergence time. This is not the case 
when the time delay is not zero. Suppose that the (un- 
normalized) final state in the presence of time delay is 
IV'(oo)) = + ^===|(/)^), where |(/);^) denotes a state 

orthogonal to 
to show that /(oo) 
0, hence up to the first order in r, \(j)g) does not depend 
on r. This is the reason why the fidelity is independent of 
T when T is very small. For large r, e.g., the terms with 
are not negligible, r•a^m,^ai■or^ K-ir ^ — L^—L' 



^A+P^ ^" """" 

g) and A is a complex number. It is easy 
fc3((<^,|V(oo))(V'(oo)|i?i|(/.,)) = 



can be calculated by 



1 3*2 



with |'0(oo)) in place of |V'(0)- Clearly, \4>^) depends on 
the delay time r, and negative and positive time delays 
play different role. 



IV. APPROACHING THE CONTROL FIELD BY 
A PULSE TRAIN 

Observing Eq.Q, we find that the control fields are 
a continuous function of time. To realize such fields in 
experiment, we need to manipulate the control fields at 
each point of time. This is a challenging task in practical 
applications. The solution to this problem is to replace 
the control field by a pulse train. Then natural questions 
arise: How many pulses in the train are necessary to 
simulate the control fields? Is the control fidelity sensitive 




FIG. 1: Fidelity as a function of time for 10 different initial 
states with time delay r = 1. The initial states are randomly 
created by a MATLAB random number generator, ignoring 
the relative phases between different components. The inset 
shows the dependence of the average fidelity on the time- 
delay. The average is taken over 10 randomly chosen initial 
states. Throughout this paper, we rescale the maximal eigen- 
value of Hq to be 1 and set %= \, the time is rescaled corre- 
spondingly. 



to the amplitude and duration of the pulse? If not, can 
we replace the Lyapunov control by a bang-bang control? 
In the following, we will answer these questions. 

We numerically simulate the open- loop system Eqs.(IT]), 
(O, (O and (O with a pulse train to replace the control 
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FIG. 2: Fidelity versus time (upper panel), and pulse ampli- 
tude as a function of time (lower panel) . The initial states for 
the upper panel are randomly chosen, while the control field 
shown in the lower panel corresponds to the red-dot line in 
the upper panel. Note that 50 pulses are taken to simulate 
the control fields as shown in the lower panel. 
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FIG. 3: Fidelity as a function of pulse number. The fidelity 
is an averaged result taken over 10 randomly chosen initial 
states. 



field f{t). Numerical results are presented in Fig [21 Two 
observations can be made. (1) 50 sequence pulses are 
enough for simulating the control fields, i.e., most ini- 
tial states can be driven into the target state with 50 
sequence pulses in place of the control field. (2) The con- 
vergence time changes (prolongs) when we use the pulse 
train to simulate the control field. As expected, the fi- 
delity depends on the number of pulse significantly as 
Fig. [3] shows, in particular around the pulse number 40, 
the fidelity changes abruptly. Of course, this observation 
depends on the problem considered. The physics behind 
these results can be understood as a wide range of k al- 
lowed in Eq. By properly choosing k at each point 
of time, we can re-arrange the control field and let it fit 
the pulse train. When the duration of pulse in the train 
is long, it is difficult to guarantee fc > 0, this degrades 
the fidelity of the control. 

In control theory, a bang-bang control (on and off con- 
trol) is a feedback control that switches abruptly between 
two states. In optimal control problems, it is sometimes 
the case that a control is restricted to be between a lower 
and an upper bound. If the optimal control switches from 
one extreme to the other at certain times (i.e., is never 



FIG. 4: Pulse and fidelity as a function of time. The 
initial state is randomly created, and in this plot, it is 
(0.4314, 0.3627, 0.5948, 0.3991, 0.4114)^. 



strictly in between the bounds) then that control is re- 
ferred to as a bang-bang one. The bang-band controls are 
often implemented because of simplicity or convenience. 
The physical idea behind bang-bang control comes from 
refocusing techniques of NMR spectroscopy Q : control 
cycles are implemented in time via a sequence of strong 
and rapid pulses that provide a full decoupling from the 
environment. The decoherence suppression results in 
the increase of the NMR transversal relaxation time T2, 
which is related to dephasing. Besides NMR, dynamical 
decoupling has been suggested for inhibiting the decay of 
unstable atomic states |9, 10], suppressing the decoher- 
ence of magnetic states [ll[ , and reducing the heating in 
ion traps [l^. 

Noticing the simplicity and wide-range application of 
the bang-bang control, one may wonder whether we can 
use the bang-bang signal to replace the control field f{t). 
The answer is yes. Before going to the detail, let us first 
examine Eq. The rate k in the control field f{t) 

implicates that the amplitude of the control field is not 
important, in contrast, its sign plays an exclusive role to 
guarantee V < 0. This is reminiscent of the bang-bang 
signals and suggests us to arrange the control field in the 
following way: 



fit) 




fit) > 0, 
fit) < 0, 
fit) = 0, 



(12) 



where /o is a constant. Fig. |3]shows the fidelity as well as 
the bang-bang signals as a function of time. We should 
address that the duration of pulse and the time inter- 
val between two pulses are different in the signal, which 
distinguishes this type of bang-bang control from the tra- 
ditional one. Besides, the bang-bang control here differs 
from the traditional one at that the design of the control 
fields /(<) is different. In the Lyapunov based control, 
the bang-bang field is designed based on the Lyapunov 
function, while in the traditional bang-bang control, the 
control fields are designed based on the cost function. 

Before closing this section, we address the issue of ef- 
ficiency of the Lyapunov control. It is believed that the 
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FIG. 5: The convergence time(upper panel) and the control 
fidelity (lower panel) versus dimension of the control system. 
The convergence time is defined as a time duration with which 
the averaged fidelity arrives at or larger than 0.95. The fi- 
delity shown in the lower panel is taken at time 150. All 
fidelities used here are averaged over 100 randomly created 
initial states. 



convergence time increases as the dimension of the con- 
trol system grows, but how does the convergence time 
depend on the dimension of the system? The conver- 
gence time here is defined as a time duration by which 
the control system arrives at the target state with a fi- 
delity of at least 0.95. Alternatively, the efficiency can 
also be described by fidelities at which the system ar- 
rives within a fixed time duration. We show both the 
convergence time and these fidelities as a function of di- 
mension in FigjS] The free Hamiltonian is randomly cre- 
ated such that it is diagonal and its maximal element is 
set to be 1, the control Hamiltonian is specified to be 
= 0,Hi{m,l) = 1 (m = 2,3,4,...),i?i(l,n) = 
1 {n = 2,3,4,...), and Hi{m,n) — for the other m 
and n. We find that the convergence time prolongs al- 
most linearly as the dimension of the system grows. Ac- 



cordingly, the fidelity degrades with the increase of the 
dimension of the control system. This finding suggests 
that Lyapunov-based control becomes difficult for high 
dimensional systems, but it is still an effective method to 
steer an open quantum system. 



V. SUMMARY AND DISCUSSIONS 

The Lyapunov control fields are traditionally required 
to manipulate at each point of time. In this paper, we 
have proposed a scheme to replace the Lyapunov con- 
trol field by a pulse train or by a bang-bang signal. Our 
analysis and numerical simulations show that the control 
field can be well simulated by a pulse train, in which each 
pulse has the same time duration but different amplitude. 
We find that the control fidelity depends on the number 
of pulses in the train, and the dependence of the fidelity 
on the pulse number is numerically given. The possibility 
to replace the Lyapunov control field by a bang-bang sig- 
nal is also explored. Surprisingly, the bang-bang signal 
works well in the Lyapunov control to replace the Lya- 
punov control fields. The physics behind the replacement 
is given and analyzed. The time-delay effect and the ef- 
ficiency of the control under the effect of the time-delay 
are also examined in this paper. These results suggest 
that the Lyapunov control not only has the advantage 
combining the feedback and open-loop control, but it is 
also easy to realize for finite dimensional quantum sys- 
tems. 
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